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Abstract 


The two most important notions of fractal dimension are Hausdorff dimension, developed by Haus- 
dorff (1919), and packing dimension, developed independently by Tricot (1982) and Sullivan (1984). 
Both dimensions have the mathematical advantage of being defined from measures, and both have 
yielded extensive applications in fractal geometry and dynamical systems. 

Lutz (2000) has recently proven a simple characterization of Hausdorff dimension in terms of 
gales, which are betting strategies that generalize martingales. Imposing various computability 
and complexity constraints on these gales produces a spectrum of effective versions of Hausdorff 
dimension, including constructive, computable, polynomial-space, polynomial-time, and finite-state 
dimensions. Work by several investigators has already used these effective dimensions to shed 
significant new light on a variety of topics in theoretical computer science. 

In this paper we show that packing dimension can also be characterized in terms of gales. 
Moreover, even though the usual definition of packing dimension is considerably more complex 
than that of Hausdorff dimension, our gale characterization of packing dimension is an exact dual 
of - and every bit as simple as - the gale characterization of Hausdorff dimension. 

Effectivizing our gale characterization of packing dimension produces a variety of effective strong 
dimensions, which are exact duals of the effective dimensions mentioned above. In general (and in 
analogy with the classical fractal dimensions), the effective strong dimension of a set or sequence is 
at least as great as its effective dimension, with equality for sets or sequences that are sufficiently 
regular. 

We develop the basic properties of effective strong dimensions and prove a number of results 
relating them to fundamental aspects of randomness, Kolmogorov complexity, prediction, Boolean 
circuit-size complexity, polynomial-time degrees, and data compression. Aside from the above 
characterization of packing dimension, our two main theorems are the following. 

1. If (3 = (Po, Pi ,...) is a computable sequence of biases that are bounded away from 0 and R is 
random with respect to P, then the dimension and strong dimension of R are the lower and 
upper average entropies, respectively, of p. 

2. For each pair of A^-computable real numbers 0 < a < P < 1, there exists A € E such that 
the polynomial-time many-one degree of A has dimension a in E and strong dimension P in 
E. 

Our proofs of these theorems use a new large deviation theorem for self-information with respect 
to a bias sequence p. 



1 Introduction 


Hausdorff dimension - a powerful tool of fractal geometry developed by Hausdorff T2j in 1919 
- was effectivized in 2000 by Lutz m izu This has led to a spectrum of effective versions of 
Hausdorff dimension, including constructive, computable, polynomial-space, polynomial-time, and 
finite-state dimensions. Work by several investigators has already used these effective dimensions 
to illuminate a variety of topics in algorithmic information theory and computational complexity 
[201 EH] [IJ 012H1 HU E3 El OH UH EES] ■ (See [20] for a survey of some of these results.) This work has 
also underscored and renewed the importance of earlier work by Ryabko 123 ESI ESI EH, Staiger 
H3 E3 ESI, and Cai and Hartmanis 0 relating Kolmogorov complexity to classical Hausdorff 
dimension. (See Section 6 of 121. for a discussion of this work.) 

The key to all these effective dimensions is a simple characterization of classical Hausdorff 
dimension in terms of gales , which are betting strategies that generalize martingales. (Martingales, 
introduced by Levy CHI and Ville m have been used extensively by Schnorr EUEaESI and others 
in the investigation of randomness and by Lutz [221 na and others in the development of resource- 
bounded measure.) Given this characterization, it is a simple matter to impose computability 
and complexity constraints on the gales to produce the above-mentioned spectrum of effective 
dimensions. 

In the 1980s, a new concept of fractal dimension, called the packing dimension, was introduced 
independently by Tricot m and Sullivan ESI- Packing dimension shares with Hausdorff dimension 
the mathematical advantage of being based on a measure. Over the past two decades, despite its 
greater complexity (requiring an extra optimization over all countable decompositions of a set in 
its definition), packing dimension has become, next to Hausdorff dimension, the most important 
notion of fractal dimension, yielding extensive applications in fractal geometry and dynamical 
systems m- 

The main result of this paper is a proof that packing dimension can also be characterized in 
terms of gales. Moreover, notwithstanding the greater complexity of packing dimension’s definition 
(and the greater complexity of its behavior on compact sets, as established by Mattila and Mauldin 
mi our gale characterization of packing dimension is an exact dual of - and every bit as simple 
as - the gale characterization of Hausdorff dimension. (This duality and simplicity are in the 
statement of our gale characterization; its proof is perforce more involved than its counterpart for 
Hausdorff dimension.) 

Effectivizing our gale characterization of packing dimension produces for each of the effective di¬ 
mensions above an effective strong dimension that is its exact dual. Just as the Hausdorff dimension 
of a set is bounded above by its packing dimension, the effective dimension of a set is bounded above 
by its effective strong dimension. Moreover, just as in the classical case, the effective dimension 
coincides with the strong effective dimension for sets that are sufficiently regular. 

After proving our gale characterization and developing the effective strong dimensions and some 
of their basic properties, we prove a number of results relating them to fundamental aspects of 
randomness, Kolmogorov complexity, prediction, Boolean circuit-size complexity, polynomial-time 
degrees, and data compression. Our two main theorems along these lines are the following. 

1. If 5 > 0 and /? = (/3o,/?i, • • •) is a computable sequence of biases with each /3i £ [<5, ^], then 
every sequence R that is random with respect to /3 has dimension 

^ n —1 

dim(R) = liminf — 7J(/3j) 

n^oo n ^' 
i =0 
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and strong dimension 


Dim(i?) = limsup — H((3i), 

n— kx> . n 

where 7i(/3i) is the Shannon entropy of /?,. 

2. For every pair of A - coinput able real numbers 0 < a < (3 < 1 there is a decision problem 
4 gE such that the polynomial-time many-one degree of A has dimension a in E and strong 
dimension (3 in E. 

In order to prove these theorems, we prove a new large deviation theorem for the self-information 
log —k —, where (3 is as in 1 above. 

flP (w) 

A corollary of theorem 1 above is that, if the average entropies ^J22=o converge to a 

limit H((3) as n —* oo, then dim(i?) = Dim(i?) = H(/3). Since the convergence of these average 
entropies is a much weaker condition than the convergence of the biases (3 n as n —► oo, this corollary 
substantially strengthens Theorem 7.7 of m- 

Our remaining results are much easier to prove, but their breadth makes a strong prima facie 
case for the utility of effective strong dimension. They in several cases explain dual concepts that 
had been curiously neglected in earlier work, and they are likely to be useful in future applications. 
It is to be hoped that we are on the verge of seeing the full force of fractal geometry applied 
fruitfully to difficult problems in the theory of computing. 

2 Preliminaries 

We use the set Z of integers, the set Z + of (strictly) positive integers, the set N of natural numbers 
(i.e., nonnegative integers), the set Q of rational numbers, the set M of real numbers, and the set 
[0, oo) of nonnegative reals. All logarithms in this paper are base 2. 

A string is a finite, binary string w £ {0,1}*. We write \w\ for the length of a string w and 
A for the empty string. For i , j £ {0,..., |u>| — 1}, we write w[i..j ] for the string consisting of the 
i th through the j th bits of w and w[i] for w[i..i\, the i th bit of w. Note that the 0 th bit rc[0] is the 
leftmost bit of w and that w[i..j] = A if i > j. A sequence is an infinite, binary sequence. If S is 
a sequence and i,j £ N, then the notations S[i..j] and 5[i] are defined exactly as for strings. We 
work in the Cantor space C consisting of all sequences. A string w £ {0,1}* is a prefix of a sequence 
S £ C, and we write w C S, if 5[0..|u;| — 1] = w. The cylinder generated by a string w £ {0,1}* is 
C w = {S £ C|u; E S}. Note that C A = C. 

Given a set A C {0,1}* and n £ N, we use the abbreviations A =n = A n {0, l} n and A< n = 
A n {0, l}- n . A prefix set is a set A C {0,1}* such that no element of A is a prefix of another 
element of A. 

For each i £ N we define a class Gi of functions from N into N as follows. 

Go = {/ | (3fc)(V°°n)/(n) < kn} 

G i+1 = 2 Gi ( log = {/ | (3g € Gi)(V°°n)/(n) < 2^")} 

We also define the functions cp £ G* by go(n ) = 2 n, (Ji+\(n) = 2^ logn '. We regard the functions in 
these classes as growth rates. In particular, Go contains the linearly bounded growth rates and G\ 
contains the polynomially bounded growth rates. It is easy to show that each Gi is closed under 
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composition, that each / £ Gi is o(gi + 1 ), and that each g t is o(2 n ). Thus Gi contains superpolyno¬ 
mial growth rates for all i > 1, but all growth rates in the Gj-hierarchy are subexponential. 

Let CE be the class of computably enumerable languages. Within the class DEC of all decid¬ 
able languages, we are interested in the exponential complexity classes E* = DTIME(2 Gi_1 ) and 
EjSPACE = DSPACE(2 Gi -i) for i > 1. The much-studied classes E = Ei = DTIME(2 linear ), 
E 2 = DTIME(2 polynomial ), and ESPACE = EiSPACE = DSPACE(2 linear ) are of particular interest. 

We use the following classes of functions. 


all 

comp 

Pi 

Pispace 


{/I/: {0,1}* -{0,1}*} 

{/ £ all | / is computable} 

{/ £ all | / is computable in Gi time} (i > 1) 
{/ £ all | / is computable in Gi space} (i > 1) 


(The length of the output is included as part of the space used in computing /.) We write p for 
pi and pspace for pispace. 

A constructor is a function 6 : {0,1}* —► {0,1}* that satisfies x^6(x) for all x. The result 
of a constructor 5 (i.e., the language constructed by 5) is the unique language R(6) such that 
6 n (X) C R(6) for all n £ N. Intuitively, 5 constructs R(6) by starting with A and then iteratively 
generating successively longer prefixes of R(6). We write R( A) for the set of languages R(6) such 
that 5 is a constructor in A. The following facts are the reason for our interest in the above-defined 
classes of functions. 
i?(all) = C. 

-R(comp) = DEC. 

For i > 1, i?(pi)=Ej. 

For i > 1, i?(pispace) = EjSPACE. 

If D is a discrete domain (such as N, {0,1}*, N x {0,1}*, etc.), then a function / : D —> [0, oo) 
is A -computable if there is a function / : N x D —> Q n [0, oo) such that \f(r,x) — f(x)\ < 2~ r 
for all r £ N and x £ D and / £ A (with r coded in unary and the output coded in binary). We 
say that / is exactly A -computable if / : D —> Q n [0, oo) and / £ A. We say that / is lower 
semicomputable if there is a computable function f : D x N —> Q such that 

(a) for all ( x,t ) £hxN, f{x,t) < f(x,t + 1) < f(x), and 

(b) for all x £ D, lim^oo f(x,t) = f(x). 

Let A: be a positive integer. A k-account finite-state gambler (k-account FSG) is a tuple G = 
(Q,5,(3,q 0l co) where 

• Q is a nonempty, finite set of states, 

• 5 : Q x {0,1} —» Q is the transition function, 

• (3 : {1,... , k} x Q x {0,1} —> Q n [0,1] is the betting function, 

• go £ Q is the initial state, and 

• c"o is the initial capital vector, a sequence of k nonnegative rational numbers. 

The betting function satisfies /3(i,q, 0) + / 3(i,q , 1) = 1 for each q £ Q and 1 < i < k. We use the 
standard extension <5* : E* —> Q of 6 defined recursively by <5* (A) = go and S*(wb ) = 6(6* (w), b) for 
all w £ {0,1}* and b £ {0,1}. 
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3 Fractal Dimensions 


In this section we briefly review the classical definitions of some fractal dimensions and the rela¬ 
tionships among them. Since we are primarily interested in binary sequences and (equivalently) 
decision problems, we focus on fractal dimension in the Cantor space C. 

For each k £ N, we let A k be the collection of all prefix sets A such that A <k = 0. For each 
X C C, we then define the families 


A k {X) 

B k (X) 


w^A ) 


< A £ A k 
{A G A k \{Vw G 4)C„nl^ 0}. 


If A G A k (X), then we say that the prefix set A covers the set X. If A G B k (X), then we call the 
prefix set A a packing of X. For X G C, s G [0, oo), and k £ N, we then define 


mx) 

Pk(X) 


inf V 

A ^ X )^ A 

sup V 2 _s ^l. 
A&B k (x) w£A 


Since H((X) and Pf(X) are monotone in k, the limits 

H S {X) = lim H* k (X), 

k—>oo 

PL(X) = lim P£(X) 

k—>oo 


exist, though they may be infinite. We then define 


P S (X ) = inf 


OO 


X c 


U*< 


i=0 


(3.1) 


The set functions H s and P s have the technical properties of an outer measure |S], and the 
(possibly infinite) quantities H S (X) and P S (X) are thus known as the s-dimensional Hausdorff 
(outer) measure of X and the s-dimensional packing (outer) measure of X, respectively. The set 
function P ^ is not an outer measure; this is the reason for the extra optimization ED in the 
definition of the packing measure. 


Definition. Let ICC. 


1. The Hausdorff dimension of X is dimn(X) = inf{s G [0, oo)\H s (X) = 0}. 

2. The packing dimension of X is dimp(X) = inf{s G [0, oo)|P s (X) = 0}. 

The proof of our main result uses a well-known characterization of packing dimension as a 
modified box dimension. For each ICC and n £ N, let 


N n (X) 


{w £ {0,l} n \(3S £ X)w ^ S} 
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Then the upper box dimension of A is 


dim B (A) = limsup l0gJVn(1) . 

n—>oo Tl 


(3.2) 


The lower box dimension dim B (A), which we do not use here, is obtained by using a limit inferior 
in place of the limit superior in eh. When dim B (A) = dim B (A), this quantity, written dim B (A), 
is called the box dimension of X. 

Box dimensions are over 60 years old, have been re-invented many times, and have been named 
many things, including Minkowski dimension, Kolmogorov entropy, Kolmogorov dimension, topo¬ 
logical entropy, metric dimension, logarithmic density, and information dimension. Box dimensions 
are often used in practical applications of fractal geometry because they are easy to estimate, but 
they are not well-behaved mathematically. The modified upper box dimension 


dim MB (A) = inf 


sup dim B (Xj) 


X C 


U-v 


i=0 


(3.3) 


is much better behaved. (Note that (13.31) . like EH>, is an optimization over all countable decom¬ 
positions of X.) In fact, the following relations are well-known 3|. 

Theorem 3.1. For all X C C, 0 < dimn(A) < diniMB^) = dimp(A") < dim B (A") < 1. 


The above dimensions are monotone , i.e., AC Y implies dim(A') < dim(K), and stable, i.e., 
dim(A U Y) = max{dim(A), dim(K)}. The Hausdorff and packing dimensions are also countably 
stable, i.e., dim(U“ 0 Aj) = sup{dim(Aj)|i £ N}. 


4 Gale Characterizations 


In this section we review the gale characterization of Hausdorff dimension and prove our main 
theorem, which is the dual gale characterization of packing dimension. 

Definition. Let s £ [0, oo). 

1. An s-supergale is a function d : {0,1}* —> [0, oo) that satisfies the condition 

d{w) > 2~ s [d(w0) + d(wl)\ (4.1) 

for all w £ {0,1}*. 

2. An s-gale is an s-supergale that satisfies i with equality for all w £ {0,1}*. 

3. A supermartingale is a 1-supergale. 

4■ A martingale is a 1-gale. 


Intuitively, we regard a supergale d as a strategy for betting on the successive bits of a sequence 
S £ C. More specifically d{w ) is the amount of capital that d has after betting on the prefix w 
of S. If s = 1, then the right-hand side of EH) is the conditional expectation of d(wb) given that 
w has occurred (when b is a uniformly distributed binary random variable). Thus a martingale 
models a gambler’s capital when the payoffs are fair. (The expected capital after the bet is the 
actual capital before the bet.) In the case of an s-gale, if s < 1, the payoffs are less than fair; if 
s > 1 , the payoffs are more than fair. 

We use the following known generalization of the Kraft inequality. 
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Lemma 4.1. (Lutz J2DJ) Let s £ [0, oo). If d is an s-supergale and B C {0,1}* is a prefix set, then 
for all w £ {0,1}* ; YIu&b 2 ~ s ^d(wu) < d(w). 

We now define two criteria for the success of a gale or supergale. 

Definition. Let d be an s-supergale, where s £ [0, oo). 

1. We say that d succeeds on a sequence S £ C if 

limsupd(<S'[0..n — 1]) = oo. (4.2) 

71—XX) 

The success set of d is S 00 [d] = {5 £ C| d succeeds on S}. 

2. We say that d succeeds strongly on a sequence S £ C if 

liminf d(S[0..n — 1]) = oo. (4.3) 

71—XX) 

The strong success set of d is S^[d] = {S' £ C| d succeeds strongly on S’}. 

We have written conditions (El) and El in a fashion that emphasizes their duality. Condition 
(14.21) says simply that the set of values d(S[0..n — 1]) is unbounded, while condition (14.311 says that 
d(S[0..n - 1]) -+ oo as n -» oo. 

Notation. Let X C C. 

1. G(X) is the set of all s £ [0, oo) for which there exists an s-gale d such that X C 

2. G str (X) is the set of all s £ [0, oo) for which there exists an s-gale d such that X C <S^[d]. 

3. Q(X) is the set of all s £ [0, oo) for which there exists an s-supergale d such that X C S'°°[d]. 

4. Q str (X) is the set of all s £ [0, oo) for which there exists an s-supergale d such that X C S^.[d]. 

Note that s' > s £ G(X) implies that s' £ G{X), and similarly for the classes £? str (X), G(X), 
and G stT {X). The following fact is also clear. 

Observation 4.2. For all ICC, Q(X) = Q(X) and G str (X) = G str (X). 

For Hausdorff dimension, we have the following known fact. 

Theorem 4.3. (Gale Characterization of Hausdorff Dimension - Lutz GJQj) For all X C C, 
dimn(^C) = inf G(X). 

Our main result is the following dual of Theorem 14.31 

Theorem 4.4. (Gale Characterization of Packing Dimension) For all ICC, dimp(X) = inf G str (X). 

By Observation 14.21 we could equivalently use G(X) and Q str (X ) in Theorems 14.31 and EH 
respectively. We will use the following lemma to prove Theorem 14.41 

Lemma 4.5. For each family of sets {X^ C C \k £ N} ; inf Q stI ((J fc Xf.) = sup fc inf G str {X}fi. 
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Proof. The inequality inf f? str ((JA,- A*,) > sup fc inf Q stT (Xk) holds trivially. 

To prove that inf f? str (Ufc A fe ) < sup fe inf C/ str (Xfc), let s > sup fc inf Q str {Xjf). Then for each 
k £ N there is an s-gale 4 such that A& C <Sg£.[4]- We define an s-gale d by 


d{w) = Y 

k£ N 


2~k 

4(A) 


dk(w) 


for all w £ {0,1}*. Then for each k, for any S £ X fc, we have 

d(5'[0..n - 1]) > -^y ■ d k (S[0..n - 1]) 

for all n, so S £ 5^ r [d]. Therefore A*. — ^strM] an d the lemma follows. □ 

Proof of Theorem \4-.4\ Let X C C. By Theorem 13.11 it suffices to show that diniMB(A) = 
inf G stl (X). 

To see that diniMBpO < inf f/ str (A), let s > inf Q str (X). It suffices to show that diniMB(A) < s. 
By our choice of s, there is an s-gale d such that X C S , “ r [d]. For each n £ N, let 


B n = {w £ {0, l} n \d(w) > d{ A)} 

and 

Y n = {S £C\S[0..n-l]£B n }. 

For each i £ N, let 

OO 

A', = f| Y n , 

n=i 

and note that 

OO 

A C |J W. (4.4) 

i =0 

For all n> i € N, we have Xj C Y n , whence the generalized Kraft inequality (Lemma 14.11) tells us 
that 

N n (Xi) < N n (Y n ) = \B n \< 2 sn . 

It follows that, for all i £ N, 

— v log N n {Xi) ^ 

dimB(Aj) = hrnsup- < s, 

n —>oo Tl 

whence by g31 ), 

dirriMB(A) < sup dime (A*) < s. 

ie N 

To see that infC/ str (X) < dimMB(A), let s > s' > s" > diniMB(A). It suffices to show that 
inf g str (X) < s. Since s" > dimMB(A), there exist sets Ao,Ai,... C C such that X = |J“L 0 A i 
and diniB(Aj) < s" for all i £ N. By Lemma ITTH it suffices to show that s £ f/ str (Aj) for all i £ N. 

Fix i £ N. Since dirrq^Aj) < s", there exists no £ N such that, for all n > no, logAr A x >) < s", 
i.e., N n (Xi ) < 2 s n . For each n > no, let 


A n = {S[0..n-l]\Se A,} 
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(noting that \A n \ = N n (Xi)), and define d n : {0,1}* —> [0, oo) by 


d n {w) = < 


2 (s-s')|w| ^ 2“ s ' |n| if |w| < n 


U 

WUEA n 


2 (s i)(M n '>d n (w[0..n — 1]) if |ui| > n. 

It is routine to verify that d n is an s-gale for each n > tiq. Note also that d n (w ) 
n > no and w £ A n . Let d = d n - Then 


2 (s-s> f or ^ 


OO OO OO 

d{ A) = = E \ A n\ 2 ~ S ' n = E N n{Xi)2~ S ' n 

n=no n=riQ n=no 

oo 

C ^2( s "- s ><oo, 

n=no 


so d is an s-gale by linearity. Let S £ Xj. Then, for all n > no, 5[0..n — 1] £ A n , so 

d(S[0..n - 1]) > d n (S[0..n - 1]) > 2^ s ~ s >. 

Thus S £ This shows that Xi C S’^ D r [d], whence s £ Q str (Xi). 


□ 


5 Effective Strong Dimensions 

Theorem roi has been used to effectivize Hausdorff dimension at a variety of levels. In this section 
we review these effective dimensions while using Theorem 14.41 to develop the dual effective strong 
dimensions. 

We define a gale or supergale to be constructive if it is lower semicomputable. For any s £ [0, oo) 
and any /c-account FSG G an s-gale d^) is defined as follows 13- (Recall that finite-state gamblers 
were defined in Section 2.) For each 1 < i < k we define an s-gale by the recursion 

d G,i( A ) = C <M 

d< G,i( wb ) = 2S dc;\(w)P(i,5*(w),b) 

for all w £ {0,1}* and b £ {0,1}. Then 

1=1 

We define an s-gale d to be finite-state if there is a finite-state gambler (FSG) G such that d^) = d. 
For the rest of this paper, A denotes one of the classes all, comp, p, pspace, P 2 , P 2 space, etc. defined 
in Section 2. 

For each T £ {constr, A, FS} and X C C, we define the sets Qy{X), t/p tr (A), Qy(X), and 
t?j? r (X) just as the classes G{X), G HtT (X). G(X), and G str (X ) were defined in Section 4, but with 
the following modifications. 


(i) If r = constr, then d is required to be constructive. 



(ii) If T = A, then d is required to be A-computable. 

(iii) In t/ps (A) and £/pg(A), d is required to be finite-state. 

(iv) £/fs(A) and Gpg(X) are not defined. 

The following effectivizations of Hausdorff and packing dimension are motivated by Theorems 
14.31 and 14.41 

Definition. Let ACC and S € C. 

1. m The constructive dimension of X is cdim(A) = inf ^ cons tr(A). 

2. The constructive strong dimension of X is cDirn(A) = inf t?®^ str (A). 

3. Wf\j The dimension of S is dirn(S') = cdim({.S}). 

4- The strong dimension of S is Dim(S') = cDim({S}). 

5. The A-dimension of X is dim a (A) = iniQ^X). 

6. The A-strong dimension of X is Dim a (A) = inf t/J r (A"). 

7. f "Wf The dimension of X in R( A) is dim(A|i?(A)) = diniA(A (1R(A)). 

8. The strong dimension of X in R{ A) is Dim(A|i2(A)) = DiniA(A n i?(A)). 

9 . m The finite-state dimension of X is dimps(A) = inf £/pg(A). 

10. The finite-state strong dimension of X is Dimpg(A) = inf (Jpg (A). 

11. The finite-state dimension of S is dimps(*S') = dimpg({5}). 

12. The finite-state strong dimension of S is Dimps(5 l ) = Dimpg({5}). 

In parts 1,2,5, and 6 of the above definition, we could equivalently use the “hatted” sets 
f?constr(A), I?constr(A), Qa(X), and (A) in place of their unhatted counterparts. In the case of 
parts 5 and 6, this follows from Lemma 4.7 of m ■ In the case of parts 1 and 2, it follows from the 
main theorem in (which answered an open question in ED, where I/constr(^) was in fact used 
in defining cdim(A)). 

The polynomial-time dimensions dim p (A) and Dim p (A) are also called the feasible dimension 
and the feasible strong dimension, respectively. The notation dim p (A) for the p-dimension is all 
too similar to the notation dirnp(A) for the classical packing dimension, but confusion is unlikely 
because these dimensions typically arise in quite different contexts. 

Note that the classical Hausdorff and packing dimensions can each now be written in three 
different ways, i.e., 

diniH(A) = dim a ii(A) = dim(A|C) 

and 

dimp(A) = Dim a n(A) = Dim(A|C). 

Observations 5.1. 1. Each of the dimensions that we have defined is monotone (e.g. , AC Y 

implies cdim(A) < cdim(T) > ). 
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2. Each of the effective strong dimensions is bounded below by the corresponding effective dimen¬ 
sion (e.g., cdim(A) < cDim(X)j. 

3. Each of the dimensions that we have defined is nonincreasing as the effectivity constraint is 
relaxed (e.g., dimnpQ < cdim(X) < dim pS p ace (X) < dimFs(Ai),). 

4- Each of the dimensions that we have defined is nonnegative and assigns C the dimension 1. 

Lemma 5.2. The finite-state dimensions are stable, i.e., for all X, Y C C, 

dirnps (X U Y) = max{dimps(^), dimps(^)} 


and 

Dimps(^ U Y) = max{DiniFs(X), Dimps(^)}- 

Proof. The stability of finite-state dimension was proved in [7]- The same arguments establish 
stability for finite-state strong dimension. □ 

Definition. Let X, Xq, X\, X 2 , ■ ■ . C C. 

1. We say that X is a A-union of the A-dimensioned sets {Xk\k £ N} if X = UfcLo Xk and for 
each s > sup fcgN diniA(^ffc) with 2 s rational, there is a function d : N x {0,1}* —► [0, 00 ) with 
the following three properties. 

(i) d is X-computable. 

(ii) For each k £ N, */ we write dffw) = d(k,w), then the function c4 
(Hi) For each k £ N, X & C S°°[dk}. 

Analogously, X is a A-union of the A-strong dimensioned sets {X^k 
with the above properties that also satisfies 

(iv) For each k £ N, X). C S“ r [(4]. 

2. We say that X is a A-union of the sets {Xk\k £ N} dimensioned in R( A) if X = Xk 
and X fl -R(A) is an A-union of the A-dimensioned sets { X^ n R(A)\k £ N}. 

Analogously, X is A-union of the sets {X^k £ N} strong dimensioned in R( A) if X = 
UfcLo Xk and X n R( A) is an A-union of the A-strong dimensioned sets {Xk fl R(A)\k £ N}. 

Lemma 5.3. The dimensions defined from A are A-countably stable, i.e., if X is a A-union of 
the A-dimensioned sets Xq, Xi, X 2 , ■ ■ ■ , then 

dim A (X) = supdimApffc), 
fee N 

and if X is a A-union of the A-strong dimensioned sets Xq, X\, X- 2 ,..., then 

Dim a (A') = supDimA(A'fc), 
fee N 

and similarly for dimension and strong dimension in R( A). 

Proof. The stability of dimA over A-unions was proved in m- The proof for strong dimension is 
analogous. □ 


is an s-gale. 

£ N} if there is a d 
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Lemma 5.4. The constructive dimensions are absolutely stable, i.e., for all ICC 


cdirn(X) = sup dim (S') 
Sex 


and 


cDirn(X) = sup Dim(S'). 

S£X 


Proof. The absolute stability of constructive dimension was proved in m using optimal construc¬ 
tive supergales. The same argument works for constructive strong dimension. □ 


6 Algorithmic Information 

In this section we present a variety of results and observations in which constructive and computable 
strong dimensions illuminate or clarify various aspects of algorithmic information theory. Included 
is our second main theorem, which says that every sequence that is random with respect to a 
computable sequence of biases /?* G [5, 1/2] has the lower and upper average entropies of (/ 3o , /3i,...) 
as its dimension and strong dimension, respectively. We also present a result in which finite-state 
strong dimension clarifies an issue in data compression. 

Mayordomo [2H1 proved that for all S' G C, 

dim(S) = liminf K ( S W" n ~ 1 D , (6.1) 

n—>oo Ti 

where K{w ) is the Kolmogorov complexity of w jTSj. Subsequently, Lutz m used termgales to 
define the dimension dim(ru) of each (finite!) string w G {0,1}* and proved that 

dim(S) = liminf dim(S[0..n — 1]) (6-2) 

n— kx> 

for all S G C and 

K(w) = | tu | dim (to) ± 0(1) (6.3) 

for all w G {0,1}*, thereby giving a second proof of (16.111 . The following theorem is a dual of (16.211 
that yields a dual of EH> as a corollary. 

Theorem 6.1. For all S G C, 


Dim(S) = lirri sup dim(S[0..n — 1]). 

n— kx) 

Proof. This proof is analogous to the one for the dual statement ( 16.211 given in [23] • □ 


Corollary 6.2. For all S G C, 


Dim(S) = lim sup 

n—»oo 


K(S[0..n 

n 


1 ]) 


By Corollary E2 the “upper algorithmic dimension” defined by Tadaki m is precisely the 
constructive strong dimension. 

The rate at which a gambler can increase its capital when betting in a given situation is a 
fundamental concern of classical and algorithmic information and computational learning theories. 
In the setting of constructive gamblers, the following quantities are of particular relevance. 
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Definition. Let d be a supermartingale, let S £ C, and let ICC. 


log d(S[0..n— 1]) 


logd(5[0..n-l]) 
r'n^oc n 


1. The lower d-Lyapunov exponent of S is Xd(S) = liming 

2. The upper d-Lyapunov exponent of S is A d{S) = limsup,, 

3. The lower Lyapunov exponent of S is X(S) = sup{Arf(5')|d is a constructive supermartingale}. 

4. The upper Lyapunov exponent of S is A(S) = sup{Ad(£)|d is a constructive supermartingale}. 

5. The lower Lyapunov exponent of X is A(A") = infs G x A(S). 

6 . The upper Lyapunov exponent of X is A(X) = infsgjv A(S'). 


Lyapunov exponents such as these were investigated by Schnorr Ei El, Ryabko m, and 
Staiger E71I3%] (using slightly different notations) prior to the effectivization of Hausdorff dimension. 
The quantities A d(S) and A d(S) are also called “exponents of increase” of d on S. It is implicit in 
Staiger’s paper m that 

-A-comp (5) = 1 - dirn comp (5) 

for all S G C, where A comp (S') is defined like A(S) above, but with d required to be a computable 
martingale. Similar reasoning leads to the following characterizations of the Lyapunov exponents. 


Theorem 6.3. Let S G C and ACC. Then A (S) = 1 — dim (S'), A (S) = 1 — Dim(S'), A(X) = 
1 — cdim(A), and X(X) = 1 — cDim(A"). 

Proof. We will show that A(S') = 1 — dim(S). A similar argument shows that A (S) = 1 — Dim(S). 
By Lemma IS.41 A(A) = 1 — cdim(A) and A(A) = 1 — cDim(X) follow from the statements about 
sequences. 

Let t < s < A(S') with t computable, and let d be a constructive martingale for which A d(S) > 
s. Then for infinitely many n, d(S'[0..n — 1]) > 2 sn . Define a constructive (1 — f)-gale d! by 
d!(yS) = 2~ t \ w \d(w) for all w € {0,1}*. Then for infinitely many n, we have d f (S[0..n — 1]) = 
2~ tn d(S[0..n — 1]) > 2 l ' s ~ t ‘ >n , so S G S , °°[d]. Therefore dim(S') < 1 — t. This holds for all computable 
t < A (S), so dim(S') < 1 — A (S’). 

Let s > dim(S’) be computable, and let d be a constructive s-gale with S G S°° [d]. Define a 
constructive martingale d! by d!(w) = 2d _s )l 1u ld(r(;) for all w G {0,1}*. For infinitely many n, we 
have d(5[0..n— 1]) > 1, and for each of these n, d , (S’[0..n — 1]) > 2( 1_s ) n . Therefore A d'{S) > 1 —s, 
so A(5) > 1 — s. This holds for all s > dim(S'), so A(S') > 1 — dim(S’). □ 

Constructive strong dimension can also be used to characterize entropy rates of the type inves¬ 
tigated by Staiger mm and Hitchcock m- 

Definition. Let A C {0,1}*. 

1. The entropy rate of A C {0,1}* is Ha = liiri sup re ^ oc iHSJAsii. 

2. We define the sets of sequences 

A Lo - = {S G C|(3°°n)5[0..n - 1] G A} 

and 

H a - e - = {S G C|(V°°n)5[0..n - 1] G A}. 
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Definition. Let ICC. The constructive entropy rate of X is 

Hce(X) = w£{H a \X C A Lo ■ and A G CE} 
and the constructive strong entropy rate of X is 

n%XX) = inf{H A \X C A a ' e ' and A G CE}. 

Hitchcock na proved that 

H C e(X) = cdim(X) (6.4) 

for all ICC. We have the following dual of IIIi- 
Theorem 6.4. For any ICC, = cDirn(X). 

Proof. This proof is analogous to the proof of (16.41) given in (12J. □ 

In the classical case, Tricot m has defined a set to be regular if its Hausdorff and packing 
dimensions coincide, and defined its irregularity to be the difference between these two fractal 
dimensions. Analogously, we define the c- irregularity (i.e., constructive irregularity) of a sequence 
S G C to be Dim(S) — dim(S), and we define the c- irregularity of a set X C C to be cDim(X) — 
cdim(X). We define a sequence or set to be c -regular (i.e., constructively regular) if its c-irregularity 
is 0. 

As the following result shows, the c-irregularity of a sequence may be any real number in [0,1]. 

Theorem 6.5. For any two real numbers 0 < a < (3 < 1, there is a sequence S G C such that 
dim(iS') = a and Dim(S) = /3. 

Proof. Let R be a Martin-Lof random sequence. It is well-known that 

K(R[0..n — 1]) > n — 0(1). (6.5) 

Write R = r\r?r-,$... where \r n \ = 2n — 1 for all n. Note that In • ■ ■ r n | = n 2 . 

For each n, define 

if log* n is odd 
if log* n is even, 

and let 

kn = l>n|7nl • 

We now define S' G C as 

S = ri 0 kl r 2 0 k2 ■ ■ ■ r n 0 kn ■ ■ ■ . 

Note that for all n, 

|r n 0 fcn | = |KI(l + 7n)l 

if log* n is odd 
if log* n is even. 

Let w C S. Then for some n, 

w = n0 kl ■ ■ ■ rn^O^- 1 ^ 


— \ r n | 
a \ ,L ' 
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where r' n C r n and 0 < j < k n . We have 


K(w) < K(n ■ ■ ■ r n -\r' n ) + K(ki) H- K{k n - 1 ) + K(j) + 0(1) 

< |n ■ ■ -rn-ir'nl + 0(n log n) 

< (n — l) 2 + 0(n log n). 


Also, 


K(n ■ ■ ■ r n -rr' n ) < K(w) + K(k i) 4-f K(k n -i) + K(j) + 0(1) 

< K(w) + 0{n log n), 

so by (16.511 . 

K(w) > K{r\ ■ ■ ■ r n -ir' n ) — 0(n\ogn ) 

> |n • • -r n -ir' n \ - 0 {n log n) 

> (n — l) 2 — O(nlogn). 

We bound the length of w in terms of n as 

H > |n|(l +7l) 4-1- |Oi— 1 1(1 +7n-l) + Wn I 

In • ■ -r n -i\ 


> 


P 


1 


and 




M < |n |(1 + 7i) 4 - 1- |r n _i|(l +7n-i) + \r n 1(1 + 7n) +n 

< l’ ,1 - r "- ir ’»l + n 


a 


1 


< —(n + 1) 2 . 


a 


From (16.61) and Q. we have 


, K(S[0..m — 1]) (n — l) 2 + O(nlogn) 

lim sup ——- - < lim sup --f-- \ 8 ’ = (3, 


m 


i(n-l) 2 


and El and (16.91) yield 


. K(S[0..m — 1]) . (n - l) 2 - 0(n log n) 

lim ml- > Inn ml-—-—- = a. 


m 


"°° b( n + l ) 2 


( 6 . 6 ) 


(6.7) 


( 6 . 8 ) 


(6.9) 


( 6 . 10 ) 


( 6 . 11 ) 


For each n, let 

w n = nO fcl • • • r n 0 fc " 

Define the sequence of towers tj by to = 1 and t- J+ \ = 2b. If j is even, then for all tj-i < i < tj, 
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7 i = Then 


KJ < tj + 5Z I^K 1 +7i) 

2=1 

7-i ^ 7 

= tj + '52 ki|(!+7i) + -g ki 

2=1 2=tj_l +1 

- + a tj2_1 + ~ 

~ + A? + o((i 0 s^) 2 )- 

Similarly, if j is odd, we have 


K 


L J 

> X]l ri l( 1 + Tt) 


7—i 

= J]|r i |( 1 + 70 + 

2=1 



a . z —' 

2=tj_l + l 




a J 


Combining m and cm we have 


( 6 . 12 ) 


(6.13) 


K(S[0..m — 1]) K(wt 2n ) 

Inn sup-- > Inn sup —:-p- > /3. 


m 


\wt 2 


Putting (EH together with CT31) yields 


ljm , nf A-(5[0..m - 1]) < ^ . nf J < ^ 


m 


K 


(6.14) 


(6.15) 


2n+l I 


By (16.11) . (16.111) . and (16.151) . we have dim(S') = a. By Corollary 16.21 (16.101) . and cm we have 
Dim(S') =0. □ 


We now come to the main theorem of this section. The following notation simplifies its statement 
and proof. 

Notation. Given a bias sequence (3 = (/3q,/3i, ...), n G N, and SgC, let 


- 1 

Hntf) = -VH(ft), 

71 2=0 

H~ 0) = lim inf H n 0 ), 

n—>oo 

H + 0) = lim sup H n 0). 


We call H {(3) and H + (/3) the lower and upper average entropies , respectively, of (3. 
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Theorem 6 . 6 . If 5 £ (0, and (3 is a computable bias sequence with each Pi £ [5, ^\, then for 
every sequence R £ RAND' 3 , 

dim(R) = H~0) and Dim(R) = H + (/3). 

Theorem 16 . 61 savs that every sequence that is random with respect to a suitable bias sequence P 
has the lower and upper average entropies of P as its dimension and strong dimension, respectively. 
Since there exist /3-random sequences in A[] when P is computable, this gives a powerful and 
flexible method for constructing A° sequences with given (A^-computable) dimensions and strong 
dimensions. 

We now develop a sequence of results that are used in our proof of Theorem 16.61 


Lemma 6.7. Assume that 6 > 0, e > 0, and that, for each P £ [5,1 — 5\, rip is a bounded random 
variable such that E rjp < —e and Ee tr, P is a continuous function of P for each t > 0. Then there 
exists 6 > 0 such that, for all P £[5,1 — 5\ and t £ (0, 0 ], 

Ee^ < 1 - -. 

2 

Proof. Assume the hypothesis. Then the Dominated Convergence Theorem |3j tells us that, for all 
P £ [< 5,1 — < 5 ], 


Ee*^ - 1 
inn - 

t^o+ t 


e tr W - 1 

lirn E- 

t—>o+ t 


= E lim 


e tr, P — 1 


t—>o+ t 

e tr H3 _ i 


E ( 71/5 lim 

' i—>o+ trip 


= e ??/3 

-e. 


Hence, for each P £ [5,1 — d], there exists tp > 0 such that, for all t £ (0,tp], 


E e tv P — 1 
t 



It follows by our continuity hypothesis that, for each P £ [A, 1 — <5], there is an open neighborhood 
Np of P such that, for all t £ (0, tp] and 7 £ Np D [<5,1 — <5], 


Ee tv " 1 - 1 


The family Q = {A^ \ P £ [5,1 — <5]} is an open cover of the compact set [5 ,1 — 5], so there is a finite 
set B C [5,1 — 5] such that the subcollection Q' = {Np \ P £ B} is also a cover of [5,1 — 5]. Let 


9 = min{tg | P £ B}. 

Then 6 > 0 and, for all P £ [5,1 — 5] and t £ (0, 6], 

Ee tr) P - 1 e 


t 
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whence 


Ee 4 ^ < 1 


te 

~ 2 ' 

□ 


Corollary 6.8. For each 5 > 0 and e > 0, there exists 0 > 0 such that, for all f3 € [8,1 — 8 \, if we 
choose a £ {0,1} with Prob[a = 1] = [3, and if 


V = €~ n (P) ~ e 


or 

V = T-L(P) - £ - e, 

where 

i = (1 - a) log -^—f + alog jF 

then 

Ee °v <l- e S. 

Proof. The random variables 


Vi,p = € ~ 'H(P) - e, 

02,f) = H{p) - £ - e 

satisfy the hypothesis of Lemma l(i. 71 with Er/i /j = Er/ 2,/3 = — e, so we can choose > 0 for r]\ Q and 
82 > 0 for 772 /3 as in that lemma. Letting 0 = min{#i, 82 } establishes the corollary. □ 

Notation. Given a bias sequence (3 = (/3o,f3i,. ..), n £ N, and S £ C, let 


L n (/3)(S) = log 


1 

pP(S[0..n 


1 ]) 


n— 1 


i=0 


where 

&(£) = (! - £[*]) lo § + log J. 

for 0 < i < n. 

Note that (/$),£o> • • • ,£n-i are random variables with 


n —1 n —1 

EL n (/3) = ^ E& = £«(&) = nH n0)- 

Z—0 i—0 

The following large deviation theorem tells us that L n {/3 ) is very unlikely to deviate significantly 
from this expected value. 

Theorem 6.9. For each 8 > 0 and e > 0, there exists a £ (0,1) such that, for all bias sequences 
f3 = (Po,/3i,. ..) with each £ [<5, 1 — 5] and all n £ TLP, if L n (/3) and H n {(3) are defined as above, 
then 

P[\L n 0) - nH n 0)\ >en) <2 a n , 
where the probability is computed according to \jP . 
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Proof. Let 5 > 0 and e > 0, and choose 9 > 0 as in Corollary 16.81 Let a = 1 — y, noting that 
a G (0,1). Let (3 be as given, and let n G Z + . Let L = L n (P), H = H n (j3 ), and ... be as 

above. The proof is in two parts. 

1. For each i € N, let rji = — TL(Pi) — e. Then Markov’s inequality, independence, and Corollary 

PI tell us that 


P[L — nH > en] 


= p[ e 0( L ~nH) > e denj 

< e - 0en Ee^ L ~ nH ^ 

j^gO(L—nH)—eQn 

= Ee^o* 
n—1 

= Ejje 0r?i 
2—0 
n—1 

= Ee evi 

i =0 


2. Arguing as in part 1 with rji = Tt(pi) — — e shows that P[niL — L > en] < a n . 

By parts 1 and 2 of this proof, we now have 

P[|L — nH\ > en] < 2a n . 


□ 

Some of our arguments are simplified by the following constructive version of a classical theorem 
of Kakutani El- Say that two bias sequences /3 and (3' are square-summably equivalent , and write 

°o 

f3 « 2 13', if (Pi - P[) 2 < oo. 

i =0 

Theorem 6.10. (van Lambalgen W2[ iHII . Vovk 253) Let 5 > 0, and let P and P' be computable 
bias sequences with Pi, P[ G [5, 1 — 5] for all iGN. 

1. If P « 2 f3', then RAND^ = RAND^'. 

2 . If P fl 2 p', then RAND^fl RAND' 3 ' = 0. 

Corollary 6.11. If 6 > 0 and p is a computable bias sequence with each Pi G [A 1 — 5\, then there 
is an exactly computable bias sequence p' with each p( G [f,/?i] satisfying RAND' 8 = RAND' 3 . 

Proof. Assume the hypothesis. Then there is a computable function g : N x N —> Q such that 
| g(i, r) — Pp < 2~ r for all i, r G N. Let m = 2+ [log j], and let 

P[ = g(i,m + i)-2 

for all i G ff. It is easily verified that P' is exactly computable, each P( G [§,/%], and P' ss 2 P, 
whence Theorem 16.101 tells us that RAND' 3 = RAND' 3 . □ 
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Lemma 6.12. If 5 > 0 and /3 is a computable bias sequence with each £ [5, 1 — <5], then every 
sequence R £ RAND /3 satisfies 

L n (/3)(R) = nH n ({3) + o(n) 


as n 


oo. 


Proof. Assume the hypothesis. By Corollary 16.111 we can assume that /3 is exactly computable. 
Let e > 0. For each n £ N, define the set 


Y n = \S £ C 


I L, 


•X(3)(S) - nH n 0)\ > enj , 


and let 

X e = {S £ C \ ( 3°°n)S £ Y n }. 

It suffices to show that ^comp(-A e ) = 0. 

For each n £ N and w £ {0,1}*, let 


d n {w) 


pHYn\C w ) 

d n (w[0..n - 1]) 


if \w\ < n 
if licl > n. 


It is easily verified that each d n is a /3-martingale and that the function ( n,w ) h- » d n (w ) is 
computable. It is clear that Y n C S’ 1 [d n ] for all n £ N. Finally, by Theorem 16.1)1 the series 

OO 

d n { A) is computably convergent, so the computable first Borel-Cantelli Lemma j22] tells us 

n=0 

that /ifomp(-Ae) =0. □ 


Lemma 6.13. If 5 > 0 and /3 is a computable bias sequence with each fii £ [<f, -t], then cdim(RAND /3 ) < 
H~(0) and cDim(RAND^) < H + (/3). 

Proof. Assume the hypothesis. By Corollary 16.1 11 we can assume that /3 is exactly computable. 
Let s G [0, oo) be computable. 

Define d : {0,1}* —> [0, oo) by 

d{w) = 2 s \ w \^{w) 

for all w £ {0,1}*. Then d is a constructive (in fact, computable) s-gale. For each R £ C and 
n £ N, if we write z n = l?[0..n — 1], then 

log d(z n ) = sn + log tiP{z n ) 

for all n. In particular, if R £ RAND' 3 , if follows by Lemma, 16.121 that 

log d(z n ) = n[s - H n (f3 )] + o(n ) (6.16) 


as n —* oo. We now verify the two parts of the lemma. For both parts, we let 

Ie = {n£ N | H n 0) <s-e}. 

To see that cdim(RAND^) < let s > iW(/3), and let e = Then the set I e is 

infinite, so (16.161) tells us that RAND' 3 C 5°°[(i], whence cdim(RAND' 3 ) < s. 

To see that cDim(R,AND' 3 ) < H + (/3), let s > H + (/3), and let e = U . 2 (|,3> . Then the set I e is 

cofinite, so (16.161) tells us that RAND' 3 C 5“ r [d], whence cDim(RAND' 3 ) < s. □ 


19 









Lemma 6.14. Assume that 5 > 0, (3 is a computable bias sequence with each (3\ £ [5,1 — <5], 
s £ [0, oo) is computable, and d is a constructive s-gale. 

1. If s< H~0), then 5°°[d] f] RAND^ = 0. 

2. If s < H + 0), then S°&[d\ f) RAND^ = 0. 

Proof. Assume the hypothesis. Define dl : {0,1}* —> [0, oo) by 


d'{w) = 


d(w) 


2 s \ w \/j,P(w) 


for all w £ {0,1}*. Then dl is a /3-martingale, and dl is clearly constructive. 

Let R £ RAND a . Then dl does not succeed on R, so there is a constant c > 0 such that, for all 
n £ N, if we write z n = R[0..n — 1], then d'{z n ) < 2 C , whence 


log d(z n ) < c + sn + log 0 {z n ). 


It follows by Lemma 1(1. 1 21 that 


log d(z n ) <c + n[s- H n {f3)\ + o(n) 


as n — * oo. Hence, for any e > 0, if we let 

I e = {neZ+\s< H n 0) - e}, 

then log d(z n ) < c for all sufficiently large n £ I e . We now verify the two parts of the lemma. 

1. If s < H~(/3), let e = H . Then I e is cofinite, so log d(z n ) < c for all sufficiently large 

n £ Z+, so R 5°°[d]. 

2. If s < H + 0), let e = — ^ - . Then I e is infinite, so log d(z n ) < c for infinitely many n £ Z + , 
so R?S£[d}. 

□ 


We now have all we need to prove the main theorem of this section. 

Proof of Theorem 1 6 . 61 Assume the hypothesis, and let R £ RAND a . By Lemma 16,1111 dim(R) < 
H~0) and Dim(R) < H + {(3). To see that dim(/?.) > H~((3) and Dim(i?) > H + (/3), let s, t £ [0, oo) 
be computable with s < H~(f3) and t < H + ((3), let d~ be a constructive s-gale, and let d + be 
a constructive f-gale. It suffices to show that R fL S 100 ^ - ] and R S'^.[d + ]. But these follow 
immediately from LeTnma. l6.14l a.nd the /3-randomness of R. □ 

Corollary 6.15. If (3 is a computable sequence of coin-toss biases such that H((3) = lim H n {(3 ) £ 

n^oo 

(0,1), then every sequence R £ C that is random with respect to [3 is c-regular, with dirn(R) = 
Dim(R) = H{[3). 
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Note that Corollary 16.151 strengthens Theorem 7.6 of |21j because the convergence of H n ((3 ) is 
a weaker hypothesis than the convergence of (3. 

Generalizing the construction of Chaitin’s random real number 17 [B], Mayordomo m and, 
independently, Tadaki m defined for each s G (0,1] and each infinite, computably enumerable set 
A C {0,1}*, the real number 


e s A = 


12 a 7T G {0,1}* and U (tt) G A j , 


where U is a universal self-delimiting Turing machine. Given (16.11) and Corollary 16.21 above, the 
following fact is implicit in Tadaki’s paper. 


Theorem 6.16. (Tadaki uni ) For each s G (0,1] and each infinite, computably enumerable set 
A C {0,1}*, the (binary expansion of the) real number d s A is c-regular with dim(0^) = Dim(0^) = s. 

We define a set X C C to be self-similar if it has the form 


X = A°° = {S' G C|5 = wqW\W 2 ... for some wq, w\,W 2 , ■ ■ ■ G A} 

where is A C {0,1}* is a finite prefix set. Self-similar sets are examples of c-regular sets. 

Theorem 6.17. Let X = A°° be self-similar where A is a finite prefix set. Then X is c-regular, 
with cdim(A) = cDim(X) = inf{s| J2 wgA 2~ s \ w \ < 1}. 

Proof. We say that a string w is composite if there are strings w\,... ,Wk G A such that w = 
w\ ■ ■ ■Wk■ Let s be computable such that < 1- For any computable e > 0 we define 

a constructive (s + e)-supergale d as follows. Let w G {0,1}*, and let v be the maximal composite 
proper prefix of w. Then 

d(w) = 2 £ H2- s (M-M). 

uGA:wC.vu 

For all composite strings w, we have d(w) = It follows that ^4°° C S'^.[d], and therefore 

cDim^ 00 ) < s + e. 

Let s such that YIwgA 2~ s I™I > 1 and let d be a s-gale. To show that cdim(y4°°) > s, it suffices 
to construct a sequence S G A°° — S'°°[d]. Initially, we let tco = A. Assume that w n has been 
defined, and let u G A such that d(w n u) < d(w n ). We know that such a u exists because of our 
choice of s. Then we let w n+ \ = w n u. Our sequence S is the unique one that has w n C S for all 

n. □ 


Dai, Lathrop, Lutz, and Mayordomo 0 investigated the finite-state compression ration pp${S), 
defined for each sequence S G C to be the infimum, taken over all information-lossless finite-state 
compressors C (a model defined in Shannon’s 1948 paper J3S]) of the (lower) compression ratio 


pc(S ) = liminf 


|C(S[0..n-l])| 


n 


They proved that 


Pfs(S) = dim FS (5) (6.17) 

for all S G C. However, it has been pointed out that the compression ratio pfs{S) differs from the 
one investigated by Ziv ESJ. Ziv was instead concerned with the ratio Rps(S) defined by 


Rfs(S) 


inf li m sup inf |C(5[ °-" 

/cEN n —»oo CdzCk 71 


i])l 
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where Ck is the set of all fc-state information-lossless finite-state compressors. The following result, 
together with (I7TT71) . clarifies the relationship between pfs(S) and Rps(S). 

Theorem 6.18. For all S £ C, Rps(S) = Dimps(S'). 


The proof of Theorem 16.181 is based on the following lemma. 

Lemma 6.19. Let C be the set of all finite-state compressors. For all S £ C, 

|<7(S[0..n-l])| 


Rfs(S) = inf limsup- 

CeC n—«x> 


n 


Proof. Let 


R'ps(S ) = inf limsup 

C£C n —>oo 


|C(5[0..n-l])| 


n 


The inequality Rps(S) < R' fs (S) is trivial. We use several results from fTj to obtain for each k £ N 
and e > 0 a finite-state compressor Ck, e that is nearly optimal for all compressors in Ck- From 
Lemma 7.7 in jj?| we obtain a finite-state gambler for each C £ Ck- By Lemma 3.7 in iTJ, we can 
combine these gamblers into a single finite-state gambler. Theorem 4.5 and Lemma 3.11 in [2 1 
convert this single gambler into a 1-account nonvanishing finite-state gambler and finally Lemma 
7.10 converts this to the finite-state compressor Ck )€ - Combining the five cited constructions in 7] 
we obtain that there is a constant c& e such that for all w £ {0,1}* and C £ Ck, 


\C k ,e(w)\ < | C(w)\ + eH + C k ,e- 


Then for all k £ N and e > 0, 


R'fs(S) — H m sup 


\Ck,t{Sf)..n — 1]) | 


n 


n — kx) 

. r |C(5[0..fi-l])| , 

< limsup ml-he, 

n — kx) C'GCfc Tl 


so Rp S (S) < Rfs(S). □ 

Proof of Theorem I ft. 1 81 The equality 


Dim FS (S) 


i„f, limsup |C(S '°; "- 1 l )l 

CSiC n —>oo ^ 


has a proof analogous to that of (IHT7I) given in 2- Together with Lemma 16.191 this implies that 
Rfs(S) = Dim FS (5). “ □ 

Thus, mathematically, the compression ratios pfs(S) an d Rfs(S) are both natural: they are 
the finite-state effectivizations of the Hausdorff and packing dimensions, respectively. 
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7 Computational Complexity 


In this section we prove our third main theorem, which says that the dimensions and strong di¬ 
mensions of polynomial-time many-one degrees in exponential time are essentially unrestricted. 
Our proof of this result uses convenient characterizations of p-dimension and strong p-dimension 
in terms of feasible unpredictability. 

Definition. A predictor is a function it : {0,1}* x {0,1} —* [0,1] such that for all w € {0,1}*, 
n(w, 0) + 7 t(w, 1 ) = 1 . 

We interpret 7 r(w, b) as the predictor’s estimate of the probability that the bit b will occur next 
given that w has occurred. We write n(p) for the class of all feasible predictors. 

Definition. Let w 6 {0,1}*, S G C, and ICC. 

1. The cumulative log-loss of n on w is 


£ log ( 


7 T,W) = 


M-i 

E log 

i=0 


Tr(w[0..i — !],«;[?']) 


2. The log-loss rate of ir on S is 


£ log (7r, S ) = liminf 

n—>oc 


£ log (7r, 5[0..n — 1]) 
n 


3. The strong log-loss rate of ir on S is 


,S) 


lim sup 

n^oo 


£ log (7r,5[0..n- 1]) 
n 


4■ The (worst-case) log-loss of it on X is 


£ log ( tt,X) = sup£ log (7r,5). 

s&x 


5. The (worst-case) strong log-loss of n on X is 

= SU P 4n( 7r >' s ')- 
Sex 


6 . The feasible log-loss unpredictability of X is 

unpredl og (X) = inf £ log (7T,X). 

irell(p) 

7. The feasible strong log-loss unpredictability of X is 

Unpredp S (X) = inf 4u( 7r >^)- 

F 7ren(p) 
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Hitchcock m showed that feasible dimension exactly characterizes feasible log-loss unpre¬ 
dictability, that is, 

unpredp g (X) = dirn p (X ) (7.1) 

for all ICC. We have the following dual result for strong dimension. 

Theorem 7.1. For all ICC, Unpred p g (A) = Dim p (X). 

The following theorem is the main result of this section. This theorem and its proof are moti¬ 
vated by analogous, but simpler arguments by Ambos-Spies, Merkle, Reimann and Stephan [l|. 

Theorem 7.2. For every pair of A®-computable real numbers x,y with 0 < x < y < 1, there exists 
A £ E such that 

dim p (degP (A)) = dim(degP (A)|E) = x 

and 

Dim p (degP (A)) = Dim(degP (A)|E) = y. 

We now develop the proof of Theorem 17.21 Our proof uses several preliminary results. 

The first part of the following theorem is due to Ambos-Spies, Merkle, Reimann and Stephan 
(Tj. The second part is an exact dual of the first part. 

Theorem 7.3. Let A £ E. 

1. dim p (degP (A)) = dirn p (P m (A)) and dim(degP (A)|E) = dirn(P m (A)|E). 

2. Dim p (degP (A)) = Dirn p (P m (A)) and Dim(degP (A)|E) = Dim(P m (A)|E). 

The following lemma is a time-bounded version of Lemma 1(1.141 

Lemma 7.4. Assume that k,l £ Z + , 5 > 0, /3 is an exactly n l -time-computable bias sequence with 
each Pi £ Q 0 [5, 1 — 5], sCQfl[0, oo), and d is an n k -time-computable s-gale. 

1. If s< H~0), then 5°°[d] f| RAND^(n fc+2Z+1 ) = 0. 

2. If s< H+0), then S&[d\ f| RAND^(n fc+2i+1 ) = 0. 

Proof. We proceed exactly as in the proof of Lemma 16.141 noting that our present hypothesis 
implies that the /3-martingale d' is 0(n fc+2?+1 )-time-computable. □ 

Our proof of Theorem 17.21 also uses the martingale dilation technique, which was introduced by 
Ambos-Spies, Terwijn, and Zheng [2] and extended by Breutzmann and Lutz 3j. 

Definition. The restriction of a string w £ {0,1}* to a language A C {0,1}* is the string w ( A 
defined by the following recursion. 

1. A \ A = A. 

2. For w £ {0,1}* and b £ {0,1}, 

(wb) ( A = 


(w r A)b ifs\ w \£A , 
w \ A if s \ w | £ A. 
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(That is, w \ A is the concatenation of the successive bits iu[z] for which Si £ A.) 

Definition. A function f : {0,1}* —> {0,1}* is strictly increasing if, for all x,y £ {0,1}*, 

x < V =>■ fix) < f(y), 
where < is the standard ordering of { 0,1}*. 

Notation. If / : {0, 1}* —» {0, 1}*, then for each n £ N, let rif be the unique integer such that 
/ i^n) = Srif ■ 

Definition. If f : {0,1}* —> {0,1}* is strictly increasing and (3 is a bias sequence, then the 
f-dilation of (3 is the bias sequence (3? given by (3n = (3 nf for all n £ N. 

Observation 7.5. If f : {0,1}* —■> {0,1}* is strictly increasing and A C {0,1}*, then for all 
n £ N, 

X/-i(A)[0-n - 1] = XA[0..n f - 1] f range(f). 

Definition. If f : {0,1}* —> {0,1}* is strictly increasing and d is a martingale, then then the 
f -dilation of d is the function f~d : {0,1}* —> [0, oo), 

fd{w) = d(w f range(f)). 

Intuitively, the /-dilation of d is a strategy for betting on a language A, assuming that d itself 
is a good betting strategy for betting on the language / _1 (A). Given an opportunity to bet on 
the membership of a string y = f(x) in A, f"d bets exactly as d would bet on the membership or 
nonmembership of x in / _1 (A). 

The following result is a special case of Theorem 6.3 in jlj. 

Theorem 7.6. (Martingale Dilation Theorem - Breutzmann and Lutz f2j) Assume that (3 is a bias 
sequence with each Pi € (0,1), / : {0,1}* —> {0,1}* is strictly increasing, and d is a pf -martingale. 
Then f~d is a P-martingale and, for every language A C {0,1}*, if d succeeds on / _1 (A), then f~d 
succeeds on A. 

Notation. For each k 6 Z + , define gk : {0,1}* —+ {0,1}* by gk(x) = O^^lx. Note that each g^ 
is strictly increasing and computable in polynomial time. 

Lemma 7.7. Assume that P is a bias sequence with each Pi G (0,1), and R £ RAND /3 (?r 2 ). Then, 
for each k > 2, gff l {R) G RAND“(n fe ), where a = (3 9k . 

Proof. Let /?, k, and a be as given, and assume that gf( 1 (R) fl RAND"(n fc ). Then there is an 
n fc -time-computable a-martingale d that succeeds on gp 1 {R). It follows by Theorem 17.61 that, gjAd 
is a /3-martingale that succeeds on R. The time required to compute g^d(w) is 0(|u;| 2 + |u>'| fc ) 
steps, where w' = w \ range(gk). (This allows 0(|rc| 2 ) steps to compute w' and then 0(|u;| fc steps 
to compute d{w').) Now |u/| is bounded above by the number of strings x such that |x| fc + |x| +1 < 

i 

|s H | = [log(l + M)J, so |u/| < 2 1+log ( 1+ l w l^, so the time required to compute g^d(w) is 

0(H 2 + 2 fc 2 fc ( log ( 1+ l^l)^) = 0(M 2 ) 

steps. Thus gk~d(w) is is an n 2 -time computable /3-martingale, so R fL RAND' 3 (n 2 ). □ 
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Notation. From here through the proof of Theorem 17.21 we assume that a and (3 are A^- 
computable real numbers with 0 < a. < (3 < 1/2. It is well-known that a real number is A^- 
computable if and only if there is a computable sequence of rationals that converge to it. Slowing 
down this construction gives polynomial-time functions a, /3 : N —> Q such that lim a(n) = a and 

n—oo 

lim $(n) = f3. We also assume that - < a(n) < $(n) for all n. For each n, we let 

n—*oo n 


n(n) 


a(n ) if n is even 
(3{n) if n is odd 


and define a special-purpose bias sequence 7 by 


In = K(log* n). 

Note that 7 is 0(n)-time-computable, Iog /- < 7 n for all n, H~( 7 ) = H(a), and H + { 7 ) = TL{f3). 

We now use the unpredictability characterizations from the beginning of this section to establish 
upper bounds on the dimensions and strong dimensions of lower spans of sequences random relative 
to 7 . 

Lemma 7.8. For each R € RAND^n 5 ), 


dim p (P m (i?)) < H{a) 


and 

Dim p (P m (R)) < Htf). 

Proof. For now, fix a polynomial-time function / : {0,1}* —> {0,1}*. The collision set of / is 

C f = {j\(3i<j)f(s i ) = f(s j )}. 

For each n € N, let 


#C f (n) = |(7/ n {0,... ,n — 1}|. 


We use / to define the predictors 

f 1 

7T^(w,b) = 

and 


if |u>| 0 C f 


w\i] b ( 1 - M?:]) 1 if |w| G Cf and i = min {j \ f(sj) = /(s|„|)} 


n{(u,,b) = l il " )b b (1 ~ 1 " )1 ~ b . ifW0C/ 

[u;[*] b (l - w^]) 1 if \w\ € C f and 1 = mm {j \ f(sj) = f(s\ w \)} 
for all w G {0,1}* and b G {0,1}. 

For each 5 G C, we now define several objects to facilitate the proof. First, we let 

Af(s) = r i (sy, 

that is, Af(S) is the language <m-reduced to S by /. Observe that for all w E Af(S), 

£ log 0ro ,w) = |iu| - #Cf(\w\). 


(7.2) 
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define 


Define the sequence of towers tj by to = 1 and tj + 1 = 2 tj . For any j € N and tj < n < tj + \. 
the entropy quantity 


H f = 


E «(7b 


i<n 

i^Cf and 


and the random variable 

L f n {S) = 


E lo s- 


1 


i<u ^(A/(S)[0..i-l]),A/(S)[il)' 

i&Cf and i 


(Recall that zj is the unique number such that f(si ) = Si f .) We have 

1 

, <n 4(Af(S[0..i-i\),Af(Sm 




^!°g- 


1 


i<„ n{(Af(S[0..i-l]),Af(S[i])) 

i<£C f 

L f n (S) + lo S 


i<n 

i&Cf and if<tj —i 


vrf(H/(S'[0..z-l]),H/(S[i])) (7-3) 


<L£(S)+ ^ l°gl°g* */ 

i<n 

i&Cf and if<tj —i 

< ^(S) + (tj_i + 1 ) log(j - 1 ) 

< L f n (S) + (1 + logn) log* n, 

for all n. (Here we used the fact that 7 * > lo[ ), - for all z.) Finally, for any e > 0 and 9 € (0,1), 
define the set 

J e,S S ) = i n I # C '/( n ) < I 1 - #) n and L n( S ) > H n + en } 

of natural numbers. 

Claim. For any rational 9 € (0,1) and e > 0, 

l ^ n s ({S' I Jo,e( S ) is fi nite }) 


= 1 . 


W = 


Proof of Claim. The argument is similar to the proof of Lemma 1(1121 For each n £ N, define the 
set 

0 if #Cf(n ) > (1 — 0)n 

{5 | Ln(S) > Hn + en} otherwise, 

and let 

X e = {S€C\(3°°n)S€Y n }. 

To prove the claim, we will show that /j? 5 (X e ) = 0. 


27 








For each n G N and w G {0,1}*, let 


H^{Y n \C w ) if |u>| < n 
d n (w[0..n — 1]) if |tc| > n. 

It is clear that each d n is a 7 -martingale and that F n C 5 1 [d n \ for all n G N. 

Let 5 G C. For each n,j G N, let 

/“ = {if \ i < n, i $Cf, and log**/ = j}. 

Also, define 5 + = {* | S[i] = 1} and S~ = {* | 5[i] = 0}. Then, if n is large enough to ensure that 
log* if < 1 + log* n for all i < n, we have 

(log* n)+1 

Li(S) = Y. n S-+I l°g — n S-1 log -—— 

fc=(log* n)-l 

For any n and k, write i(n, k) = \I%\. Let T n be the set of all tuples (Z_i, Zo, h) satisfying 0 < l r < 
i(n, j + r ) for —1 < r < 1 and 

1 1 f 

lr log —r——r + (i{n, j + r) - l r ) log -——- > + en, 

«(.J + H 1 - + r ) 

where j = log* n. Then we have 




M^) = E If n{j + r) lr (l — n(j + 7 -))*( n,J +r)-L_ 

{l-i,lo,h)eT n r=-l ' r ' 

We can write a similar formula for // r (y n |C„,) when w ^ X. From this it follows that the mapping 
(n,w) 1 —> d n (w) is exactly computable in 0 (n 3 ) time. 

By Theorem ESI there exists <5 G (0,1) such that for all n G N with Y n 7 ^ 0, we have 

fj?(Y n ) < 2 5 n ~* c s^ < 25 dn . 


It follows that the series ^ d n (\) is p-convergent, so a routine extension of the polynomial-time 

n=0 

first Borel-Cantelli Lemma m tells us that /j? 5 (X e ) = 0. □ Claim. 

Let R G RAND^(n 5 ). Let e > 0 and 9 < H(a) be rational. Then by the above claim, Jg e (R) 
is finite. That is, for all but finitely many n, 

#Cf(n) > (1 — 6)n or L^R) < + en. (7.4) 

Writing w n = Af (ZZ)[0..n — 1], (17.41) combined with Q and Q implies that 

jr} os (-jrf,w n ) <9n< TL(a)n (7-5) 

or 

£ log ( 7 r{,w n ) < H[ + en + (1 + logn) log* n. (7.6) 
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As 


it follows that 


i jj 

limsup—— < Tt(/3), 

n—>oo Ti 


limsup < w(<3) + £ . 


n 


if C33 holds for infinitely many n, then 

jC lo ^ f 0 ,Af(R))<Ti(a). 

Otherwise, m holds for almost all n. Assuming 


in this case we have 


fff 

lim inf —— < H(a ), 

n— kx ) 77, 


£ loB (7rf,^(i2)) <H(a) + 


(7.7) 


(7.8) 


(7.9) 


(7.10) 

We now verify (THU) . For each n, let m(n) = t Then for sufficiently large n, we have if < t n +\ 
for all i < m(n). Using the sets from the proof of the claim, we then have 


H 


m(n) 


jm(ri) 

J- n 


H(n(ri)) + 


T-m(n) 

n +1 


H(n(n + 1)) 


< (t n + \)H(n{n)) + m(n)H.(K(n + 1)). 


As t n = o(m(n )) and tz(2n) —> a as n —> oo, we have 


fjf (0 n 

lim mf- < Inn ml-- 

n—>oo n n^co m(2n + 1) 


< H{a). 


For each polynomial-time reduction /, we have dehned and analyzed two predictors 7 Tq and ir(. 
We now show how to combine all these predictors into a single predictor that will establish the 
lemma. 

Let {fj | j E N} be a uniform enumeration of all polynomial-time functions fj : {0,1}* —> {0,1}* 
such that fj(x) is computable in 0(2^1 +j) steps. For any predictor p, define a probability measure 
p[p\ by 

p[p\{w) = n p(w[0..i-l],w[{\) 
i=0 

for all w E {0,1}*. For each m E N and w E {0, l} m , let 


Pm(w) 


_ 2 _ ( 2 m+l) 


m-1 / \ 

+ £ 2- <2J+3 > y,[4‘](w) + -nln{’}(w) . 

3=0 V ' 
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Then 


/Wi (wO) + n m +1 (wl) = 


< 

< 


2 -| 2m+ 3) + E 2_W+3) (m[4 J ](»0) + 

+2 -(2 m+ 3) + y' 2 -(23+3) + T[jr{'](u.l)) 

J =0 ' ' 

2 _ (2m+2) + £ 2-W+3) ^ [vr f ](„,) + ^K™)) 

2- (2m+3) (2 + ^t]H + ^kMn) + /imW - 2 

// m M + 2 “( 2m+3 ) ( 3 + 0 " 2 “ (2m+1) 

MmM- 


Now define a predictor 7 r by 

7r(u;, 1) 

7r(lU, 0 ) 

Then for all w G {0,1}* and b G {0,1}, 


MM+iM) 

/V|M 

1 — ir(w, 1 ). 


ir(w, b ) > 


V\w\+i (wb) 

H\w\{w) 


For all w G {0,1}*, i G {0,1}, and j < |io|, we have 


£ log (7r, w) 


< 


< 


M - 1 

\ log- 

K tt(w[ 0 ..*-!],«;[*]) 


'Vlnr W^l 0 "*-!]) 
££ g W+ i(M0.i]) 


log 


/h)(A) 

M| W |H 


log 


2^+3+* 


2 j + 3 + i + £ log ( 7 rf J , w). 


For any j G N, it follows that 

C^{ir,A^(R))<H(J3) + e 

by using / = fj in (17.711 . Also, since either (17.81) or (17.101) holds for f = fj, we have 


£ log ( 7 T,A f *(R))<H(a) + e. 


( 2 m+l) 
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As 7r is (exactly) polynomial-time computable, this establishes that 

P m (R) = {Ah(R) \ j £ N} 

has p-dimension at most Tt(a) + e by (17.11) and strong p-dimension at most H(/3) + e by Theorem 
rrn As e > 0 was arbitrary, the lemma follows. □ 

Proof of Theorem m in the case x = TL{a), y = 7i(/3), where a,/3 € Q and 0 < a < /? < 1/2. 

By a routine diagonalization, there is a language A £ RAND 7 (n 5 ) D E. By Theorem 17.31 it 
suffices to prove that 

dirn p (P m (A)) = dirn(P m (A)|E) = H(a) 

and 

Dirn p (P m (A)) = Dirn(P m (A)|E) = 

By Lemma m then, it suffices to prove that 


dim(P m (A)|E) > H(a) 


and 


Dim(P m (A)|E) > TL{f3). 

To see that these hold, let s,t £ Q with s < H(a) and t < H(/3), let k £ Z + , let d~ be an n fc -time 
computable s-gale, and let d + be an n fc -time computable t-gale. It suffices to show that 


P m (A) HE £ S°°[dT 


and 


(7.11) 

P m (A)nE£S s ? r [d + ] (7.12) 

Let B = It is clear that B £ P m (A) D E. Also, by Lemma 17771 B £ RAND 7 (n fc ), where 

f = f 9k + 3 . Since 

s < H(pt) = H~{ 7) = H-tf) 

and 

t < H(f3) = H + ( ; y) = H + (f') 

and 7' is 0(n)-time-computable, Lemma 17.41 tells us that B 0 and B 0 *S^[d + ]. Thus 17.ill 

an d 17.121 hold. 

□ 

In light of Theorem 1731 the following question concerning the relativized feasible dimension of 
NP is natural. 

Open Question 7.9. For which pairs of real numbers a, (3 £ [0, 1] does there exist an oracle A 
such that dim p A(NP A ) = a and Dim p A(NP' 4 ) = (3? 

We conclude this section with two brief observations. 

Fortnow and Lutz m have recently established a tight quantitative relationship between p- 
dimension and feasible predictability. Specifically, for each ACC, they investigated the quantity 
Pred p (A) which is the supremum, for all feasible predictors 7r, of the (worst-case, upper) success 
rate 

7r + (S') = inf limsup7r + (S[0..n — 1]) (7.13) 

S(zX n—>o o 
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where 


M- 1 

7 t + ( w ) = ^2 7r(wi[0..i — l],u>[i]) 
i =o 

is the expected number of correct predictions that ir will make on w. They proved that Pred p (X) 
is related to the p-dimension of X by 

2(1 - Pred p (X)) < dim p (Y) < 77(Pred p (Y)) (7.14) 

(where TL{a) is the Shannon entropy of a) and that these bounds are tight. If we call Pred p (Y) 
the upper feasible predictability of X and define the lower feasible predictability of X, pred p (X), in 
the same fashion, but with the limit superior in (177131) replaced by a limit inferior, then we have 
the following dual of (i7m 

Theorem 7.10. For all ICC, 

2(1 - pred p (X)) < Dim p (Y) < 7f(pred p (Y)). 

For each s : N — * N, let SIZE(s(n)) be the class of all (characteristic sequences of) languages 
A C {0,1}* such that, for each neN, A =n is decided by a Boolean circuit consisting of at most 
s(n) gates. 

Theorem 7.11. For each a € [0,1], the class X a = SIZE(a~) is pspace-regular, with dim pspace (X a ) 
Dim pspace (X a ) = dim(X a |ESPACE) = Dim(X Q |ESPACE) = a. 

Proof. It was shown in m that dim pspace (A 0 ,) = dim(AQ,|ESPACE) = a. This proof also shows 
that the strong dimensions are a. □ 

Acknowledgment. The third author thanks Dan Mauldin for extremely useful discussions. 
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